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Abstract 



We study the so-called nonconventional averages in the context of 
lattice spin systems, or equivalently random colourings of the integers. 
For i.i.d. colourings, we prove a large deviation principle for the num- 
ber of monochromatic arithmetic progressions of size two in the box 
[1, N] fl N, as N — > oo, with an explicit rate function related to the 
one-dimensional Ising model. 

For more general colourings, we prove some bounds for the number 
of monochromatic arithmetic progressions of arbitrary size, as well as 
for the maximal progression inside the box [1, N] n N. 
Finally, we relate nonconventional sums along arithmetic progressions 
of size greater than two to statistical mechanics models in dimension 
larger than one. 



1 Introduction 



Nonconventional averages along arithmetic progressions are averages of the 
type 

1 - 

-^/^(I,).../^) (1) 

i=l 

where (X n ) is a sequence of random variables, and fi, . . . , fi are bounded 
measurable functions. 

Motivation to study such averages comes from the study of arithmetic 
progressions in subsets of the integers, and multiple recurrence and multiple 
ergodic averages. In that context, typically Xj = T l (x), with T a weakly 
mixing transformation, and x is distributed according to the unique invariant 
measure. See e.g. [9j [TJ [TT] for more background on this deep and growing 
field. 

Only recently, starting with the work of Kifer [T4j , and Kifer and Varad- 
han (T5], central limit behavior of nonconventional averages was considered. 
These authors consider averages along progressions more general than the 
arithmetic ones. It is natural to consider the averages of the type ([TJ from a 
probabilistic point of view and ask questions such as whether they satisfy a 
large deviation principle, whether associated extremes have classical extreme 
value behavior, etc. 

These questions are far from obvious, since even in the simplest case of 
fi being all identical, the sum 

N I 

i=i 3=1 

is quite far from a sum of shifts of a local function. In particular it is highly 
non-translation invariant. From the point of view of statistical mechanics, 
large deviations of S^/N are related to partition function and free energy 
associated to the "Hamiltonian" Sn- Since Sn is not translation-invariant 
and (extremely) long-range, even the existence of the associated free energy 
is not obvious. 

In this paper, we restrict to random variables Xi taking values in a finite 
set. For the sake of definiteness, we assume the joint distribution to be a 
Gibbs measure with an exponentially decaying interaction to obtain fluctua- 
tion properties of Sn in a straightforward way. In Section [3] we obtain some 
basic probabilistic properties using Gaussian concentration and Poincare's 
inequality which are available for the Gibbs measures we consider. 
In Section |4j we explicitly compute the large deviation rate function of 
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jr ^2 i= iXiX2i when the X^s are i.i.d. Bernoulli random variables. Even if 
this is the absolute simplest setting, the rate function turns out to be an inter- 
esting non-trivial object related to the one-dimensional Ising model. Recently 
there has been a lot of interest in multifractal analysis of non-conventional 
ergodic averages p2l E2 E3 IS]- Large deviation rate functions are often re- 
lated to multifractal spectra of conventional ergodic averages. In the present 
context, this connection is not as straightforward as it is in the context of 
sums of shifts of a local function. We expect the results of this paper to 
be useful in establishing such connection in the context of non-conventional 
averages. 

Finally, we analyze in the last section the case of arithmetic progressions 
of size larger than two. This naturally leads to statistical mechanics models in 
dimension higher than one, possibly having phenomenon of phase transitions. 
Conversely the classical Ising model in dimension d > 1 can be related to 
specific unconventional sums, which we describe below. Such a connection 
deserves future investigations. 

2 The setting 

We consider .fT-colorings of the integers and denote them as a, r], elements of 
the set of configurations Q = {0, . . . , K} z . We assume that on Q there is a 
translation-invariant Gibbs measure with an exponentially decaying interac- 
tion, denoted by P. This means that, given a G {0, . . . , K}, for the one-site 
conditional probability 

<fa(a) = P(cr = a\cr z \ {0} = a) 
we assume the variation bound 

- V^lloo < e~ np 

for some p > whenever a and fj agree on [— n, n] D {Z \ {0}}. This class 
of measures is closed under single-site transformations, i.e., if we define new 
spins a\ = F{ai) with F : {0, 1, . . . , K} — » {0, 1 ... , K'}, K' < K, then P', 
the image measure on {0, 1 . . . , K'} z , is again a Gibbs measure with expo- 
nentially decaying interaction, see e.g. p2] for a proof. In the last section, 
we restrict to product measures. 

For the rest of the paper we consider only 2-colorings (i.e. K = 1). Given 
an integer £, we are interested in the random variable 

N I 

e n °* 

i=l j=l 
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which counts the number of arithmetic progressions of size t with "colour" 1 
(starting from one) in the block [1, Nk}. 

If we consider i^-colorings and monochromatic arithmetic progressions, 
i.e., random variables of the type 

N I 
i=l j=l 

for given a G {0, . . . , K}, then we can define the new "colors" a[ = l(erj = a) 
which are zero-one valued and, as stated before, are distributed according to 
P', a Gibbs measure with an exponentially decaying interaction. Therefore, 
if we restrict to monochromatic arithmetic progressions, there is no loss of 
generality if we consider 2-colorings. 
Define the averages 

^ N i 
i=l 3=1 

Several natural questions can be asked about them and about some related 
quantities. We give here a non-exhaustive list. Questions 1 and 2 on this 
list have been answered positively in the literature in a much more general 
context (see [9] for question 1 and [HI EE] for question 2). On the contrary 
questions 3 and 4 have not been considered before. 

1. Law of large numbers: Does A e N converge to (E(cr )) £ as N — > oo with 
P probability one ? 

2. Central limit theorem: Does there exist some a 2 > such that 

VN(A%-(E(a Q )) e )-^+Ar(0,a 2 ), asiV^oo? 

3. Large deviations: Does the rate function 

I(x) = lim lim — — logP (A e N G \x — e, x + e\) 

exist and have nice properties ? In view of the Gartner-Ellis theorem 
[B], the natural candidate for / is the Legendre transform of the "free- 
energy" 

7(X) = lim -^-\ogE(e NXA ") 

provided this limit exists and is differentiable. If, additionally, J 7 is 
analytic in a neighborhood of the origin, then the central limit theorem 
follows [3]. 
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4. Statistics of nonconventional patterns. Let 
M{N) = 

m&x{k G N : 3 1 < i < N/k such that <7j = 1, a 2 i — 1, . . . , <J ki = 1} 

be the maximal arithmetic progression of colour 1 starting from zero 
in the block [l,iV]. One would expect 

M(N) « C\ogN + X N 

where < C < oo and is a tight sequence of random variables with 
an approximate Gumbel distribution, i.e., 

e -cie- < P (x iV < x ) < e^ C2e ^. 

Related to this is the exponential law for the occurence of "rare arith- 
metic progressions": Let 

Tip) = inf{n GN:31<i< n/isuch that o { = 1, a 2i = 1, . . . ,cr a = 1} 

be the smallest block [l,n] in which a monochromatic arithmetic pro- 
gression can be found with size k. Then one expects that T(£), ap- 
propriately normalized, has approximately (as £ — > oo) an exponential 
distribution. Finally, another convenient quantity is 

[N/e\ e 

mj)= En^ = L^J4v/*j 

i=l j=l 

which counts the number of monochromatic arithmetic progressions of 
size t inside [1, N]. 

The probability distributions of these quantities are related by the fol- 
lowing relations: 

P(K(N,i) = 0) = F{M{N) <£)= F{T{£) > N) . 

3 Some basic probabilistic properties 

In this section we prove some basic facts about the nonconventional averages 
considered in the previous section. 

Proposition 3.1. 
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1. Gaussian concentration bound. Let t > 1 be an integer. There exists a 
constant C > such that for all n > 1 and all t > 

P(K-EK)|>i)<e-™ 2 . (2) 

In particular, A e N converges almost surely to (E(o"o)) £ as N goes to 
infinity. 

2. Logarithmic upper bound for maximal monochromatic progressions. 
There exists 7 > such that for all c> 7 

/C(iV,clogA0 ->• 

in probability as N — > 00. 

Proof. A Gibbs measure for an exponentially decaying interaction satisfies 
both the Gaussian concentration bound (see e.g. jl]), and the Poincare 
inequality [3]. For a bounded measurable function / : Q — > R let 

Vif(a) = f(a*) - f{a) 

be the discrete derivative at i 6 Z, where a % is the configuration obtained 
from o G Q by flipping the symbol at i. Next define the variation 

5if = sup Vif(a) 

and 

¥f\\l = Y,^f) 2 - 

Then, on the one hand, we have the Gaussian concentration inequality: there 
exists some c\ > such that 

P(|/-E(/)|>t)<e (3) 

for all / and t > 0. On the other hand, we have the Poincare inequality: 
there exists some C2 > such that 

E[(/-E/) 2 ] <c 2 J2 /(VjfdP (4) 
for all /. Now choosing 

/ = A 
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we easily see that 

WWl < ? 2 /n . 

This combined with ^ gives ([2]). To see that this implies almost-sure 
convergence to E(<7o) , we use the strong mixing property enjoyed by one- 
dimensional Gibbs measures with exponentially decaying interacting [TOj 
Chap. 8], from which it follows easily that 



which implies 

This in turn implies 



\E(a k i\cr r i,r ^ k) -E(<r )| < Ce 
|E(W 2j • • ■ °u) ~ E(a ) £ \ < C t e~ 



lim EUi) = E(cr ) 

N—>oo 



Combining this fact with ^ yields the almost-sure convergence of to- 
wards E(o"o)^ as n goes to infinity. The first statement is thus proved. 
In order to prove the second statement, we use the bound 



< e" 7<? 



(5) 



for some 7 > and for all ii, . . . , i q G Z. This follows immediately from the 
'finite-energy property' of one-dimensional Gibbs measures, i.e., the fact that 
there exists S G (0, 1) such that for all a G Q, a G {0, 1} 



5 < P ((To 



a 



<l-5. 



As a consequence 

v,(II 



K r=l 



< l(j G {i,2i,...,£i}) Y[ a ri 



and hence, using the elementary inequality (%2i=i a «) — N ^i=i a h we have 
the upper bound 

[N/l\ I 

\V 3 IC(N,i)\ 2 <NJ2 H°irHj e {i,2i,...,£i}). 

i=l r=l 

Integrating against P, using ^ and summing over j yields 

J (V i /C(A^,£)) 2 dP < N 2 e~^ . 



Choosing now 

£ = £(N) = clog A^, 

and using Q, we find 

Vax()C(N,£(N))) < CN 2 ~ C ~< . 

Hence, for 7 > 2/c, the variance of )C(N, clog N) converges to zero. Since 

E(JC(N,£(N)) < Ne~^ k < N 1 -^, 

the expectation of JC(N,£(N)) also converges to zero, hence we have conver- 
gence to zero in mean square sense and thus in probability. □ 



4 Large deviations for arithmetic progressions 
of size two 

From the point of view of functional inequalities such as the Gaussian concen- 
tration bound or the Poincare inequality, there is hardly a difference between 
sums of shifts of a local function, i.e. conventional ergodic averages, and their 
nonconventional counterparts. 

The difference becomes however manifest in the study of large deviations. 
If we think e.g. about 5^ i=1 a i (T i+i versus ^2 i=1 <Ji&2i as "Hamiltonians" then 
the first sum is simply a nearest neighbor translation-invariant interaction, 
whereas the second sum is a long-range non translation invariant interac- 
tion. Therefore, from the point of view of computing partition functions, the 
second Hamiltonian will be much harder to deal with. 

In this section we restrict to the product case, by choosing P p to be 
product of Bernoulli with parameter p on two symbols {+,—}, and consider 
arithmetic progressions of size two (k = 2). We will show that the thermo- 
dynamic limit of the free energy function associated to the sum 

N 

i=i 

defined as 

F p {\)= lim ll og E p (e AS ") (6) 

iv— >oo iv 

exists, is analytic as a function of A and has an explicit expression in terms 
of combinations of Ising model partition functions for different volumes. 



S 



To start, assuming N to be odd (the case N even is treated similarly), 
we make the following useful decomposition 



8n - si 



N+l 

(N) 



1=1 

with 

Mi(N)-l 

— ^ °"(2Z-l)2 lCr (2Z-l)2 i + 1 (7) 
i=0 

and 

N 



Mt(N) 



log 2 



2/ - 1 



+ 1 



where |_^J denotes the integer part of x. The utility of such decomposition is 
that the random variable is independent from for I ^ I'. A similar 
decomposition into independent blocks has also been used independently in 
[7J [8]. This implies that the partition function in the free energy Q will 
factorize over different subsystems labeled by / G {1, . . . , (N + l)/2}, each of 
size Mi(N) + 1. Therefore we can treat separately each variable S$ N \ 
Furthermore, defining new spins 

r? = <r (2 ,_ 1)2 i-i for ze{l,...,M,(iV) + l}, 

it is easy to realize that, for a given le{l,...,(N+ l)/2}, the variable sf° 
is nothing else than the Hamiltonian of a one-dimensional nearest-neighbors 
Ising model, since 

' Mi{N) 



T i T i+1 



where are Bernoulli random variables with parameter p, independent for 

D 

different values of I and for different values of i and = denotes equality in 
distribution. Introduce the notation 

Z{\, h,n + l)= eAE " =1 nn+1+h ^ n 

re{-l,l} n+1 

for the partition function of the one-dimensional Ising model with coupling 
strength A and external field h in the volume {1, . . . , n}, with free boundary 
conditions. Then we have 



E 



, p ( e *El=inn + i\ = (p^l - v ))^ Z(\,h,n + I) (8) 



9 



with h = |log(p/(l — p)). A standard computation (see for instance [2], 
Chapter 2) gives 



Z(\,h,n+1) = v T M n v= \v T -e + \ 2 A n + + \v T ■ e„\ 2 A n 

with A± the largest, resp. smallest eigenvalue of the transfer matrix (with 
elements M U)P = e Ao/3+ t i.e., 



A± = e A cosh(fc) ± \ smh 2 (h) + e" 4A , 



v T the vector with components (e fc//2 , e~ h ^ 2 ), e± the normalized eigenvectors 
corresponding to the eigenvalues A±. 

Using the decomposition we obtain from ^ 



(N+l)/2 



logE p (e AS -) = J2 lo S (p('i--p) m ^ ±1 2(X,h,M l (N) + 1)) . 
i=i 



Furthermore, observing that 



(N+l)/2 



^Jf E M t {N) = \ U{x)dx 
i=i J 



with 



we obtain 



log 2 



x 



+ 1 



FpM = \(J *P( x ) dx + 1) iog(p(i - p)) 

+ i ^ log (\v T ■ e + \ 2 A% {x) + \v T • e„| 2 A^ } ) dx. 

To obtain a more explicit formula one can make use of the following: the 
normalized eigenvector corresponding to the largest eigenvalue is 



with 



IF+II 

-e" A 
e h+x _ A 
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and moreover 

i T i 9 iiii9 1T 1 i 9 i/7\ i 7 1 l 9 

\v -e_| = \\v\\ — \v ■ e + \ = 2 cosh(/i) — \v • e+| . 
Since ?/>(x) = n + 1 for a; G (l/2 n+1 , l/2 n ], we have 

/^)dx = 2, 

hence one gets 

J- p (A) = log (b(l - p)]l\v T ■ e + \ A + ) + ^(A) (9) 

with 

In the case p = 1/2, we have h = 0, A + = e A + e~ A , |t> T • e + | 2 = \\v\\ 2 = 2 
which implies <?(A) = and 

^i/ 2 (A) = logQ(e A + e- A )) . (10) 

One recognizes in this case the Legendre transform of the large deviation 
rate function for a sum of i.i.d. bernoulli (1/2) because (only) in this case 
p = 1/2 the joint distribution of {cria 2 i,i G N} coincides with the joint 
distribution of a sequence of independent Bernoulli (1/2) variables. When 
p 7^ 1/2, although an explicit formula is given in (|9]), the expression reflects 
the multiscale character of the decomposition and it is non-trivial. 
As a consequence of the explicit formula ([9]), we have the following 

Theorem 4.1. 

1. Large deviations. The sequence of random variables ^ satisfies a large 
deviation principle with rate function 

I p (x) = sup (Ax — .Fp(A)) 

where J>(A) is given by 

2. Central limit theorem. The sequence of random variables 

N- 1 ' 2 {S N - E p (S N )) 

weakly converges to a Gaussian random variable with strictly positive 
variance a 2 = ^(0) > 0. 
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Proof. The expression ([9]) shows that T p is differentiable as a function of 
A, hence the first statement follows from the Gartner-Ellis theorem [5]. The 
second statement follows from the fact that T v is analytic in a neighborhood 
of the origin, which again follows directly from the explicit expression. □ 



Remark 4.1. The value p = 1/2 is special since in this case the joint dis- 
tribution of {piGiiii G N} coincides with the joint distribution of a sequence 
of independent Bernoulli(l/2) variables. Therefore we must have 



h/2(x) 



|(1 + x) log (1 + x) + |(1 - x) log (1 - x) if \x\ < 1 , 
-oo if \x\ > 1 . 




This can be checked by computing as done above (see (10),). We must 
also have a 2 = 1 forp =1/2. 

Remark 4.2. Notice that we computed the large deviation rate function in 
the ±1 setting. If one considers a Bernoulli measure Q p on {0, with 
Qp(Vi = 1) = P> then the large deviations of the sums 

N 

^ViV2i (11) 

1=1 

correspond to the large deviations of 

1 N 1 
-^(1 + ^(1 + ^) = - 

i=i 

where a is distributed according to F p on {+, — } z . In particular, the free 
energy for the large deviations of (11) under the measure Q1/2 corresponds 
to a free energy of the a spins with non-zero magnetic field and hence can 
again be computed explicitly. 

Remark 4.3. A plot of the free energy for a few values of p is shown in 
Figure^ (it is enough to analyze values in (0, 1/2] since J-'p(X) = J r i^ p (X)). 
In the general case p ^ 1/2 it is interesting to compare our results to the 
independent case. To this aim one consider the sum ^2f =1 ^rji where rji 
are two sequences of i.i.d. Bernoulli of parameter p. Note that in this case 
the family {CiVi}ie{i,...,N} made of independent Bernoulli random variables 
with parameter p 2 + (1 — p) 2 . An immediate computation of the free energy 
yields on this case 

J** d) (A) = log ([p 2 + (l-p) 2 }e x + 2p(l-p)e-") (12) 

This free energy is compared to that of formula |$[) in Figure^ 
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Figure 1: Plot of the free energy function for different p values. The graph has 
been obtained from formula Q truncating the sum to the first 100 terms. 




Figure 2: Plot of the free energy function Q (continuous line) and of the free 
energy of the independent case (12) (dashed line). 



In particular one can analyze the behaviour of the minimum of the free 
energy functions in the two cases, corresponding to the negative value of the 
large deviation rate function computed at zero. This is shown in Figure [3j 
which suggests a general inequality between the two cases. 
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Figure 3: The negative of the minimum of the free energy as a function of p for 
the two cases ([9| and (12). 



5 Size larger than two and Ising model in 
higher dimension 

In this Section we analyze the case of arithmetic progressions of size larger 
than two. Such a case naturally leads to statistical mechanics models in 
dimension higher than one, possibly having phenomenon of phase transitions. 
Conversely the classical Ising model in dimension d > 1 can be related to 
specific unconventional sums, which we describe below. 



5.1 Decompositions for k > 2 

When the size of the arithmetic progressions is larger than two (k > 2), we 
have sums of the type 

N 

Sn = °i (J 2i ■ ■ ■ O'ki , 
i=l 

where <7j are i.i.d. random variables taking values in the set { — 1,+1}. One 
can try to decompose this sum into independent sums as it was done in 
Section |4} After relabeling the indices one obtains independent sums, each of 
which corresponds to a spin system with Hamiltonian in a bounded domain 
of N dfc , where the dimension dk is given by the number of prime numbers 
contained in the set {2, . . . , k}. Denoting by p%,P2, ■ ■ ■ ,Pd k the prime numbers 
contained in {2, . . . , k} and defining 

Ap '■= {fn G {2, . . . , iV} : m is not divisible by p} 
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and 

A {N) ._C\ A {N) 
1=1 

then one has the following decomposition: 



Sn — ^2 S ^ 



T-& A p 1 ,...,p d 



The independent sums Sm are given by translation-invariant Hamiltonians 
of the form 

c(N) _ \^ rH (m) 
°m — 2-^1 x x 

xcn d k 



where the spins are given by 



T 



X 

(m) 



n 



n 



0'ij2,.--Jd t ,)ex 



and the couplings are 



J 



(m) 



A' 



1 iiX = T l X{k) for some IeA™ ir ^(iV) 
otherwise 



with 

a: 



pi,-,Pd, 



(TV) 





1 N 






i N 




|o,i,..., 


log Pl — 
m 


h 


■x|o,l,..., 


lo §Pd t — 

ra k m 


) 



C N a 



T\X the translation of the set X by the vector /, and X(k) a specific sub- 
set of N dfc depending on the size of the arithmetic progression k. This set 
X(k) is a polymer starting at the origin and having k vertices. The spe- 
cific shape of X{k) sets the range of interaction along each direction of the 
dk— dimensional lattice. In general the shape of the interaction depends on 
the non-prime numbers contained in {2, ... , k}. 

We clarify this construction with a few examples. 



k = 2 

N 

/] CTi<T2i 



i=l 



E E 

i(JV) £eA™(JV) 



(m) (m) 



This Hamiltonian is the 1-dimensional nearest-neighbor Ising model of 
Section [4] constructed from the basic polymer X(2) = {0, 1}. 
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• k = 3 



TV 



i=l meA™ (iJ)6A-(/V) 



E E 



(m) (m) (m) 



This corresponds to a 2-dimensional nearest-neighbor model with triple 
interaction obtained via the polymer X(3) = {(0, 0), (0, 1), (1, 0)}. 

k = 4 

N 



i=l 



(m) (m) (m) (m) 



This gives a 2-dimensional model sums with quadruple interaction con- 
structed by translating the polymer X(4) = {(0, 0), (1, 0), (2, 0), (0, 1)}. 
The range of interaction is 2 in one direction and 1 in the other direc- 
tion. 

• k = 5 

N 
i=l 

— °"m-2 4 3J5 ; ^m^+^S' °Vrt-2^+ 2 3J '5' (T m-2 i 3i+ 1 5 l < J m-2 i &5 l + 1 

me4% (^".0eA^ 3i5 (JV) 

EV^ (m) (m) (m) (m) (m) 



'i+2,j,l 



ve4% (^".06^3,5 W 



Here we get a 3-dimensional model with quintuple interaction given by 
the basic polymer X(5) = {(0, 0, 0), (1, 0, 0), (2, 0, 0), (0, 1, 0), (0, 0, 1)}. 
The range of interaction is 2 in one direction and 1 in the other two 
directions. 
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5.2 Unconventional sums related to 2-dimensional Ising 
model 

We consider now the standard 2-dimensional neirest-neighbor Ising model 
sums 

^ T i,j( T i+l,j + r i,j+l) 
(ij')eA 

in a domain A of N 2 , and wonder whether there exist some unconventional 
averages that may be related to it through the decomposition procedure 
previously described. The answer is in the affirmative sense and is contained 
in the following two examples. 

• For {o"i}j G N a sequence of independent random variables taking values 
in {— 1,+1}, we have 

N 



i=l 



in 



eA (N) (i,j)eA% 3 (N) 



EST T (m) (T (m) 4- T (m) ^ 



with rffi = o" m .2*3J- This clearly gives a decomposition into \A^\ 
independent two-dimensional nearest-neighbor Ising sums. 

Let a it j be i.i.d. dichotomic random variables labeled by G N 2 . 
Then 

N 

(T hi{ (T ^h3 + °»,2j) — y^ 0'm-2 i ,m-2i {&m-2 i + 1 ,m-2i + &m-2\m-2i+ 1 ) 

ij=i meA W (ij)eAy(JV) 

= E E 

meAf ) (i»?)6Ay(JV) 

with i/}^ := o" m .2% m -2J- We have a decomposition into l^^l indepen- 
dent two-dimensional nearest-neighbor Ising sums. 
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